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SUMMARY 


Objective 

The  objective  was  to  determine  the  feasibility  of  developing  a  method  for  prioritizing  job  tasks  within  a  specialty 
in  terms  of  hazard,  possibility  of  accidents,  and  other  factors  of  concern  to  training  designers. 


Background 

Safety  is  a  major  concern  on  all  Air  Force  jobs,  but  certain  career  areas  are  more  hazardous  than  others.  The  Air 
Force  Inspection  and  Safety  Center  at  Norton  AFB  requested  the  development  of  methods  for  identifying  hazardous  job 
tasks  that  could  be  used  as  an  indicator  for  improved  training  and  thus  reduce  injuries  and  loss  of  equipment,  time, 
and  materials  caused  by  on-the-job  accidents.  Related  research  and  development  (R&D)  has  frequently  dealt  with  the 
study  of  accident  proneness  in  individuals.  While  some  R&D  has  been  concerned  with  job-related  measures,  few 
experiments  actually  addressed  the  relation  between  job  tasks  and  accidents. 


Approach 

This  effort  deals  with  the  identification,  measurement,  and  prediction  of  accident-prone  tasks  for  three  Air  Force 
specialties.  Accident  descriptions  were  matched  to  the  tasks  being  performed  when  the  accidents  occurred.  All  tasks 
were  measured  by  obtaining  ratings  from  airmen  and  supervisory  personnel  on  various  job  and  task  factors.  A  hazard- 
potential  task  factor  rating  scale  was  developed  for  the  effort.  Several  regression  models  were  tested  for  efficiency  in 
predicting  accident  occurrence  and  frequency.  Finally,  four  alternative  strategies  for  obtaining  an  ordered  list  of 
hazardous  tasks  within  a  specialty  were  proposed. 


Specifics 

Method.  Criterion  data  were  developed  by  determining  which  job  tasks  were  associated  with  accidents.  Accident 
data  for  Aircraft  Armament  specialists  (462X0),  Fire  Protection  specialists  (571X0),  and  Fuels  specialists  (631X0)  were 
obtained  from  computer  files  at  the  Air  Force  Inspection  and  Safety  Center.  Subject-matter  specialists  reviewed  accident 
reports  for  each  specialty  covering  a  3-year  period  from  July  1975  to  June  1978.  They  also  reviewed  task  lists  developed 
by  the  Air  Force  Occupational  Measurement  Center  to  determine  which  tasks  were  being  performed  when  the  accidents 
occurred.  Dependent  measures  in  the  effort  were  (a)  frequency  of  accident  occurrence  on  a  given  task  and  (b)  whether 
accidents  occurred  at  all. 

Predictor  variables  included  the  following  task  factors:  hazard  potential,  consequences  of  inadequate  performance, 
task  delay  tolerance,  task  difficulty,  and  field-recommended  training  emphasis.  Data  on  these  variables  were  collected 
by  mail  surveys  of  supervisors  in  the  field.  In  addition,  percentage  of  time  spent  performing  a  task,  percentage  of  members 
performing,  and  weighted  average  military  grade  performance  were  taken  from  occupational  survey  data  and  included 
as  potential  predictors. 

Most  of  the  analyses  were  performed  using  Comprehensive  Occupational  Data  Analysis  Programs.  These  included 
generating  various  descriptive  data  (frequency  distributions,  means,  standard  deviations)  on  the  variables,  determining 
level  of  intenater  agreement  on  rating  factors,  performing  correlation  and  regression  analyses  to  predict  accident 
occurrences,  and  developing  a  cost-benefit  training  model. 

Findings  and  Discussion.  Several  methods  were  developed  for  determining  safety  training  priorities,  each  varying 
in  the  extent  of  information  it  makes  available.  The  simplest  method  relates  the  accident  data  to  the  occupational  survey 
data.  Although  this  method  identifies  accident  tasks,  it  does  not  identify  those  tasks  that  have  not  yet  been  associated 
with  accidents  (but  are  likely  to  be  in  the  future).  The  second  method  uses  printouts  that  list  all  tasks  performed  in  the 
specialty  ordered  from  the  highest  rated  hazardous  task  through  the  lowest  rated  hazardous  task.  This  method  identifies 


both  tasks  that  have  had  accidents  and  tasks  that  are  likely  to  have  accidents.  The  third  approach  uses  predicted  scores 
from  a  safety-training  regression  model.  This  method  takes  into  account  the  amount  of  exposure  to  a  task  as  well  as  how 
many  people  are  performing  the  task.  The  fourth  method,  the  cost-benefit  analysis,  allows  for  the  estimation  of  how  much 
money  might  be  saved  if  certain  tasks  are  trained  due  to  their  accident  potential,  based  on  predicted  scores. 


Cone  fusions 

This  R&D  effort  brought  together  several  tools  and  capabilities  that  already  existed  within  the  Air  Force  and 
combined  them  in  a  new  way  to  assist  the  training  community  in  identifying  hazardous  tasks.  The  expertise  of  subject- 
matter  specialties  was  used  to  determine  accident  tasks.  In  addition  to  existing  technology,  new  procedures  were 
introduced.  For  example,  a  new  task  factor  rating  scale  for  measuring  hazard  potential  was  developed  and  is  now 
available.  A  new  computer  program  was  also  developed  that  has  the  capability  of  estimating  training  cost  savings  based 
on  the  number  of  tasks  receiving  safety  training. 
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SAFETY  TRAINING  PRIORITIES 


I.  BACKGROUND 

An  ever  present  problem  in  all  occupations  is  the  occurrence  of  accidents.  Wherever  the  human  element  is  present, 
the  possibility  of  accidents  exists.  The  means  to  identify  accident  areas,  measure  the  associated  hazards,  and  eliminate 
the  hazards,  however,  are  elusive.  A  major  problem  in  identifying  hazardous  situations  that  lead  to  accidents  is  that 
accident  occurrences  are  very  infrequent  in  relation  to  the  frequency  of  performance  of  work  tasks.  Additionally,  most 
accidents  are  rather  inconsequential  in  nature.  Disastrous  or  almost  disastrous  accidents  are  rare  and,  therefore,  very 
difficult  to  predict.  The  Air  Force  has  historically  been  very  interested  in  methods  for  reporting  and  classifying  accidents 
and  near-accidents  (Thorndike,  1951;  Vasilas,  Fitzpatrick,  DuBois,  &  Youtz,  1953).  The  present  study  examines 
accidents  and  the  tasks  being  performed  when  accidents  occur;  furthermore,  it  proposes  several  methods  for  ordering 
hazardous  tasks  to  determine  safety  training  priorities.  Standard  Air  Force  accident  reports  are  used  to  aid  in  the 
identification  and  prediction  of  hazardous  tasks. 


Review  of  Relevant  Literature 


Research  and  development  (R&D)  on  safety  issues  can  be  approached  by  studying  (a)  the  characteristics  of 
individuals  involved  in  accidents,  (b)  the  hazards  associated  with  equipment,  (c)  the  hazards  associated  with 
environment,  and  (d)  the  relationship  of  hazards  to  job  tasks.  Virtually  all  published  studies  deal  with  one  or  a 
combination  of  the  first  three  approaches. 

In  a  comprehensive  look  at  the  human  factors  involved  in  accidents,  Thorndike  (1951)  concluded  that  there  appear 
to  be  real  individual  differences  in  tendencies  to  have  accidents.  Mintz  (1954)  found  that  there  may  be  individual 
differences  in  accident  proneness  among  taxi  drivers  but  that  having  an  accident  did  not  seem  to  increase  the  driver’s 
accident  susceptibility.  Webb  (1956)  supported  this  viewpoint  when  he  determined  that  accidents  could  not  be  reduced 
by  selecting  pilots  on  the  basis  of  whether  they  had  been  involved  in  prior  accidents. 

In  further  accident  proneness  studies,  Jenkins  (1956,  1961)  developed  a  job  attitude  survey  as  a  safety  index  that 
measured  personality  traits  of  accident-prone  people  in  industrial  settings.  Kerr  ( 1950)  suggested  that  accident  proneness 
may  be  a  group  psychological  phenomenon  as  well  as  an  individual  phenomenon  and  that  a  change  in  the  psychological 
frame  of  reference  to  raise  the  level  of  alertness  in  employees  might  decrease  accidents. 

Although  the  human  element  must  be  considered  when  accidents  occur,  other  job-related  factors  should  be  studied 
also.  North  American  Rockwell  Corporation  (Hiltz,  1968)  used  fault  tree  analysis  to  identify  systems  failures  that  might 
lead  to  fatalities.  Fine  (1971)  studied  hazardous  situations  and  proposed  a  risk  score  formula  to  measure  these  situations. 

Although  it  is  important,  as  a  preliminary  step,  to  identify,  measure,  and  try  to  eliminate  hazardous  conditions, 
it  is  even  more  important  to  try  to  predict  future  accidents.  Such  prediction  would  allow  for  the  application  of  preventive 
measures,  such  as  training  or  the  elimination  of  unsafe  conditions.  Goeller  ( 1 969)  presented  a  paper  at  the  nation’s  First 
Regional  Highway  Safety  Conference  that  proposed  a  possible  prediction  model  for  making  safety  priority  decisions  for 
traffic  safety  systems.  This  model  traced  steps  leading  to  an  accident  and  predicted  the  impact  of  various  safety  activities. 


Objectives 

The  present  effort  examined  the  safety  problem  by  studying  the  relationship  of  the  hazard  potential  of  job  tasks 
and  other  job  task  data  to  the  occurrence  of  accidents  while  performing  the  job  tasks.  A  major  hypothesis  of  the  study 
was  that  accident  frequency  for  a  specific  task  could  lx1  expressed  as  a  joint  function  of  hazard  potential,  criticality, 
difficulty,  and  exposure.  An  additional  factor,  the  weighted  average  grade  of  the  personnel  performing  a  task,  was  also 
considered.  It  was  expected  that  tasks  performed  by  lower  average  grade  personnel  would  be  associated  with  more 
accidents  because  such  airmen  would  have  less  experience.  The  purpose  was  to  develop  a  method  of  rank-ordering  job 
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tasks  in  terms  of  hazard  potential,  expected  occurrence  of  accidents,  and  other  pertinent  factors  that  could  assist  Air 
Force  training  designers  in  determining  qualitative  requirements  for  safety  training.  The  specific  objectives  were  to 
identify  job  tasks  that  were  being  performed  when  accidents  occurred,  predict  which  tasks  would  likely  be  associated 
with  accidents  in  the  future,  and  develop  one  or  more  methods  for  ordering  potentially  hazardous  tasks. 

If.  APPROACH 

The  approach  was  to  assemble  task  inventories  and  accident  data  and  to  determine  which  tasks  were  being  performed 
when  accidents  occurred.  Data  were  then  collected  from  subject-matter  experts  and  analyses  were  performed  to  establish 
job  task  priorities  in  terms  of  safety  training,  to  develop  regression  models  to  predict  tasks  requiring  special  safety 
training,  and  to  develop  a  cost  trade-off  model  for  training  accident-related  tasks. 


Job  Tasks 


Job  tasks  performed  in  three  different  occupational  specialties  were  the  basic  units  of  analysis  used  in  the  study. 
The  job  tasks  were  those  defined  in  task  inventories  developed  by  the  Air  Force  Occupational  Measurement  Center  at 
Randolph  AFB.  These  task  listings  were  used  because  they  were  comprehensive  and  current. 


The  three  Air  Force  occupational  specialties  chosen  for  study  were  the  Aircraft  Armament  specialty  (Air  Force 
Specialty  Code  (AFSC)  462X0),  formerly  Weapons  Mechanic,  the  Fire  Protection  specialty  (AFSC  571X0),  and  the  Fuels 
specialty  (AFSC  631X0).  They  were  chosen  because  airmen  in  these  specialties  were  identified  by  the  Air  Force 
Inspection  and  Safety  Center  as  having  relatively  high  numbers  of  ground  accidents  (as  opposed  to  flying  accidents)  as 
compared  to  other  specialties. 


Aircraft  Armament  is  a  large  specialty  consisting  of  approximately  12,500  airmen,  about  2,400  of  whom  serve  at 
a  supervisory  level.  The  work  in  the  specialty  is  described  by  a  527-task  inventory.  The  work  deals  primarily  with  the 
loading  and  unloading  of  aircraft  munitions  and  weapons;  however,  it  also  involves  performing  flight-line  inspections, 
conducting  operational  checks,  and  maintaining  equipment  (Burns,  Barucky,  &  Ruck,  1976). 

In  the  Fire  Protection  specialty,  there  are  approximately  6,000  airmen,  710  of  whom  are  supervisory  personnel. 
Their  work  is  described  by  484  tasks.  Most  of  the  personnel  assigned  to  this  specialty  work  in  the  areas  of  fire  extinguisher 
maintenance,  aerospace  structural  firefighting  and  crash/rescue,  fire  alarm  center  operations,  and  supply  (Kopala, 
Keeth,  &  Lee,  1978). 

The  Fuels  specialty  has  the  shortest  task  list  (374  tasks)  and  is  comprised  of  approximately  7,000  airmen,  950  of 
whom  serve  in  a  supervisory  capacity.  The  major  nonsupervisory  jobs  in  this  specialty  are  field  auditing,  mobile 
distribution  and  hydrant  fueling,  hydrant  fueling/maintaining,  bulk  storing,  cryogenics,  air  transportable  hydrant 
systems,  miscellaneous  distribution,  quality  control,  and  flight-line  monitoring  (Eustis,  DiTullio,  Nolle,  &  Ruck,  1976). 


Data  Collection  Procedures 


Accident  Reports 

Reports  of  accidents  occurring  in  the  three  specialties  were  obtained  from  the  Air  Force  Inspection  and  Safety 
Center,  Safety  Education  Department,  Norton  AFB  for  the  period  July  1975  to  June  1978.  The  accident  reports  were 
in  narrative  form,  including  such  information  as  accident  location  and  date,  the  cost  per  accident,  and  a  description 
of  each  accident.  Originally,  accidents  occurring  from  July  1975  through  December  1976  in  the  Aircraft  Armament  career 
ladder  were  analyzed.  Additional  accident  data  were  later  collected  for  this  career  ladder  for  the  time  period  of  January 
1977  through  June  1978  to  be  used  in  a  cross-validation  analysis.  During  this  second  phase  of  data  collection.  Fire 
Protection  and  Fuels  specialties  were  added  to  the  effort  to  allow  for  cross-application  of  the  models  developed  for  the 
Aircraft  Armament  specialty. 


8 


As  a  first  step  in  the  analysis,  it  was  necessary  to  identify  which  tasks  in  the  job  inventory  were  being  performed 
when  the  accidents  occurred.  The  training  schools  for  the  three  specialties  (Lowry  AFB-Aircraft  Armament;  Chanute 
AFB-Fire  Protection  and  Fuels)  were  asked  to  choose  five  subject-matter  experts  from  each  specialty.  Copies  of  accident 
narratives  and  the  job  inventory  task  lists  were  mailed  to  the  schools  and  the  subject-matter  experts  were  asked,  as  a 
group,  to  link  one  or  more  tasks  with  each  accident  and  record  their  findings  on  a  form  provided  to  them. 

Task  Factor  Ratings 

Ratings  were  collected  on  several  task  factors.  Task  factor  ratings  are  measurements  obtained  from  rating  scales 
describing  various  characteristics  of  tasks  in  job  inventories.  The  task  factor  rating  scales  used  in  this  study  were  (a) 
hazard  potential,  (b)  consequences  of  inadequate  performance,  (c)  task  delay  tolerance,  and  (d)  task  difficulty.  The  task 
factor  survey  procedure  was  developed  at  the  Air  Force  Human  Resources  Laboratory  (Mead,  1975;  M;-’  &  Christal, 
1974;  Ruck,  Thompson,  &  Thomson,  1978;  Stacy,  Thompson,  &  Thomson,  1977;  Thompson  &  Ru'  ^’’8,  1979). 
This  procedure  provides  a  method  for  rating  tasks  on  selected  factors,  collecting  the  ratings  from  supe  >rs  in  the  field 
and  analyzing  the  resultant  ratings. 

The  hazard-potential  factor  was  designed  to  measure  those  tasks  that  are  considered  more  haz.  j  ^an  others 
due  to  environmental,  individual,  or  systems  problems.  The  hazard  factor  was  suggested  in  a  study  that  »'  ,ied  human 
effects  on  nuclear  systems  safety  (Askren,  Campbell,  Seifert,  Hall,  Johnson,  &  Sulzen,  1976).  The  hazard  potential  rating 
scale  is  a  nine-point  scale  which  ranges  from  extremely  low  hazard  potential  “1”  through  extremely  high  hazard  potential 

Consequences  of  inadequate  performance  and  task  delay  tolerance  are  measures  of  criticality.  Consequences-of- 
inadequate-performance  measures  perceived  consequences  in  terms  of  destroyed  material,  wasted  time,  injury,  or  loss 
of  life.  It  differs  from  hazard  potential  by  addressing  what  happens  when  a  task  is  incorrectly  performed.  Hazard  potential 
may  exist,  however,  even  when  a  task  is  performed  correctly.  Task  delay  tolerance  indicates  how  much  time  may  elapse 
before  a  task  must  be  performed  to  avoid  serious  consequences.  For  instance,  administering  emergency  medical  aid 
requires  that  little  time  may  elapse  before  performing  the  tasks;  whereas,  a  great  deal  of  time  may  elapse  before  filling 
out  forms.  Task  difficulty  measures  the  estimated  time  required  to  learn  to  perform  a  task  satisfactorily.  The  task  factors 
and  a  description  of  each  are  shown  in  Table  1 . 

Materials.  To  collect  the  task  factor  data,  survey  booklets  were  constructed  consisting  of  task  lists  and  rating  scales. 
Each  survey  booklet  contained  only  one  task  factor  rating  scale.  Appendix  B  contains  survey  booklet  instructions  and 
sample  survey  sheets.  All  scales  were  nine-point  scales.  For  hazard  potential,  subjects  were  asked  to  check  tasks  that 
were  applicable  to  the  task  factor  scale  and  rate  only  those  tasks  checked.  All  tasks  not  checked  were  assigned  zero 
ratings.  Table  A7  (Appendix  A)  defines  the  verbal  anchors  of  each  of  the  task  factor  scales. 

Respondents.  The  raters  for  each  task  factor  survey  in  all  three  specialties  were  supervisory  7-  and  9-skill-level 
noncommissioned  officers,  randomly  selected  from  personnel  files.  For  the  first  administration  of  the  new  hazard- 
potential  scale,  approximately  1000  supervisors  were  surveyed  in  the  Aircraft  Armament  specialty.  For  the  subsequent 
administration  of  that  scale,  as  well  as  the  administration  of  the  inadequate  performance  and  delay  tolerance  scales, 
approximately  100  supervisors  from  the  specialty  areas  were  surveyed.  The  number  of  supervisors  responding  on  each 
task  factor  ranged  from  34  to  803,  with  the  median  number  of  raters  across  specialties  being  78. 

Survey  Methods.  Copies  of  survey  booklets  were  printed  and  mailed  to  supervisors  in  the  field.  Distribution  of 
booklets  was  accomplished  by  mailing  the  booklets  to  the  Consolidated  Base  Personnel  Offices  (CBPOs)  at  selected  bases. 
The  CBPOs  were  then  responsible  for  disseminating  the  booklets  to  selected  supervisors  and  collecting  completed 
surveys.  Two  months  were  allotted  for  return  of  the  booklets,  resulting  in  a  return  rate  of  approximately  60%  of  the 
booklets  mailed  out. 


Job  Factors 


In  addition  to  the  task  factors,  three  job  factors  that  were  already  available  from  historical  data  files  were  used  in 
the  analysis.  These  factors  were  chosen  because  they  are  measures  of  exposure  to  the  job  tasks.  They  represent  how 
much  time  was  spent  on  the  tasks  relative  to  other  tasks  and  how  many  people  were  performing  the  tasks.  These  factors 
are  potentially  related  to  accident  occurrence  simply  because  the  more  a  task  is  performed  or  the  greater  number  of  people 
who  perform  the  task,  the  greater  the  chances  for  accidents  to  occur.  The  first  factor  was  the  percent  of  apprentices  and 
journeymen  with  1  to  48  months  total  active  military  service  (TAFMS)  pierforming  each  task.  The  second  factor  was 
piercent  time  spient  pierforming  the  task  by  apprentices  and  journeymen  with  1  to  48  months  TAFMS.  Percent  time  is 
computed  from  raw  1  to  9  scale  ratings  and  converted  to  percentages  totaling  100%  for  each  airman.  The  computation 
is  performed  by  dividing  each  task  time  spent  rating  by  the  sum  of  time  spent  ratings  for  all  tasks  performed  by  a  given 
airman  and  multiplying  by  100.  Typically,  these  individual  percent  time  values  are  averaged  across  airmen  to  represent 
the  percent  time  spent  by  a  group  of  people  for  a  given  task.  The  third  job  factor  was  the  weighted  average  military  grade 
of  individuals  performing  each  task.  This  is  based  on  the  percentage  of  members  at  each  level  actually  performing  each 
task.  Tables  1  and  A7  (in  the  Appendix)  contain  additional  information  about  the  job  factors. 


Analysis 

In  order  to  explore  the  rather  complex  safety  data,  several  types  of  analyses  were  performed.  Many  of  the  analyses 
were  accomplished  using  the  Comprehensive  Occupational  Data  Analysis  Programs  (Chrislal  &  Weissmuller,  1976; 
Goody,  1976;  Morsh  &  Christal,  1966).  The  analyses  addressed  issues  of  identification  of  accident  tasks,  task  factor 
reliabilities,  descriptive  data,  accident  prediction,  and  cost-benefit  applications. 

To  determine  task  factor  reliabilities  or  the  degree  of  agreement  among  the  raters,  interrater  agreement  indices  (Ru) 
(Lindquist,  1953)  were  obtained  for  each  task  factor  by  specialty.  Intercorrelations  among  the  task  factors,  job  factors, 
and  criteria  were  also  studied  to  determine  bivariate  relationships  among  the  variables.  The  variables  in  combination 
were  then  evaluated  using  regression  techniques  to  determine  which  factors  were  predictive  of  accident  occurrence. 
Accident  occurrence  was  defined  in  two  ways:  (a)  the  frequency  of  occurrence  of  accidents  and  (b)  the  dichotomous 
occurrence/non-occurrence  of  accidents.  Consideration  was  given  to  predicting  the  probability  of  an  accident  occurring 
if  the  task  were  performed  once;  however,  in  order  to  predict  probabilities,  it  would  have  been  necessary  to  have  frequency 
of  pierfoimance  data  which  were  not  available  and  could  not  be  collected  within  the  time  limitations  of  this  study. 

A  cross-validation  analysis  was  applied  to  the  Aircraft  Armament  specialty  to  find  out  how  well  the  predictive 
efficiency  of  the  variables  held  up  when  applied  to  a  second  set  of  criterion  data.  Cross-application  analyses  were  also 
performed  across  the  three  specialties  to  determine  how  well  weights  from  one  specialty  predicted  the  criteria  in  other 
specialties. 

Finally,  utility  analysis  was  performed  using  cost-benefit  concepts  to  determine  at  what  peint  the  greatest  accident- 
avoidance  savings  could  be  achieved  for  the  Air  Force  with  minimum  safety  training  cost.  To  perform  the  analysis,  it 
was  necessary  to  generate  predicted  scores  for  each  task  in  the  specialty,  the  reperted  cost  of  accidents,  and  the  estimated 
cost  of  supplying  safety  training  for  each  task . 


III.  RESULTS 

Identification  of  Accident  Tasks 

Table  2  shows  the  number  of  accidents  occurring  and  number  of  tasks  incurring  accidents  for  each  specialty.  One 
of  the  major  problems  encountered  in  analyzing  accident  data  is  the  small  number  of  accidents  that  occur  and  the  small 
number  of  tasks  involved  with  those  accidents.  Some  accidents  involved  more  than  one  task.  Only  4.2%  of  the  tasks 
for  Aircraft  Armament  were  accident  tasks,  4.8%  of  the  tasks  for  Fire  Protection  were  accident  tasks,  and  6.2%  of  the 
Fuels  tasks  were  accident  tasks.  Tables  A!  thru  A3  (Apptendix  A)  list  the  accident  tasks  and  the  number  of  associated 


accidents  for  each  specialty.  The  tasks  are  analyzed,  listed,  and  performed  within  broader  duties;  therefore,  the  accident 
data  were  also  reviewed  by  duty  category.  Tables  A4  through  A6  list  the  accident  duties  and  number  of  associated 
accidents  for  each  specialty. 


Table  2.  Accident  Data  Summarised  for  Aircraft  Armament 
Sample  1  (462X0),  Fire  Protection  (571X0),  and  Fuels  (631X0) 


Specialty 

Number  of  Tasks 
in  Inventory 

Number  ofTaska 
Associated  w/Aee  ideate 

Number  of  Occurrences* 
of  Accidents  on  Tasks 

Aircraft  Armament 

527 

22 

54 

Fire  Protection 

484 

23 

88 

Fuels 

374 

23 

103 

“Some  accidents  involved  more  than  one  task.  See  Appendix  A,  Tables  A1  -A3. 


Task  Factor  Reliability 

Initially,  the  reliabilities  of  the  various  task  factors  used  as  predictors  were  examined.  Table  3  reports  the  interrater 
agreement  (Rkk)  for  each  task  factor  for  each  specialty.  The  rater  agreement  indices  are  for  sample  sizes  of  50  raters 
as  estimated  by  the  Spearman-Brown  formula  (Guilford,  1965).  Stable  reliability  estimates  were  obtained  for  all  task 
factors.  Apparently,  the  raters  for  each  factor  in  each  specialty  were  in  good  agreement  on  how  to  rate  the  tasks  on  the 
scales  used.  The  percentage  of  members  performing  and  the  percentage  of  time  spent  were  not  subject  to  analyses  of 
interrater  agreement  since  those  job  factors  are  expected  to  vary  considerably  within  a  specialty. 


Table  3.  Interrater  Agreement  (Ru)  of  Task  Factors 
for  Aircraft  Armament  (462X0),  Fire  Protection  (571X0),  and  Fuels  (63 1X0) 


1 

3 

Aircraft 

Fire 

Protection 

Fuel. 

Hazard  Potential 

.93 

.98 

.98 

Consequences  of  Inadequate  Performance 

.94 

.90 

.93 

Task  Delay  Tolerance 

.89 

.96 

.92 

Task  Difficulty 

.93 

.97 

.95 

•Rater  agreement  indices  all  based  on  a  sample  size  of  50  raters  and  are  estimated  by  the  Spearman-Brown  formula. 


Descriptive  Summary 

Bivariate  analyses  included  inspection  of  the  correlations  of  all  task  and  job  factors.  Tables  4,  5,  and  6  report 
intercorrelations  for  the  three  specialties.  Hazard  potential  and  consequences  of  inadequate  performance  were  highly 
and  significantly  correlated  (£<.05)  in  all  three  specialties.  Correlations  between  the  two  were .  70  for  Aircraft  Armament, 
.64  for  Fire  Protection,  and  .84  for  Fuels.  Hazard  potential  correlated  significantly  (£<.05)  with  frequency  of  occurrence 


of  accident*  on  task*  for  Aircraft  Armament  and  for  Fuel*  (£<.05),  but  not  for  Fire  Protection.  However,  the  percentage 
of  time  spent  correlated  significantly  with  frequency  of  occurrence  of  accident*  for  all  specialties.  The  mean  ratings  and 
the  standard  deviations  for  each  task  and  job  factor  for  each  specialty  are  listed  in  Table  7.  Generally,  the  lowest  mean 
ratings  came  from  the  hazard-potential  scale  and  the  highest  mean  ratings  came  from  the  consequences-of-inadequate- 
performance  scale. 


Table  4.  Zero-Order  Correlations  Among  Variables 
for  Aircraft  Armament  (462X0)* 


‘Correlations  above  .088  are  significant  at  the 0.5  level,  N  =  527. 

bNote  that  task  delay  tolerance  is  an  inverted  scale,  with  a  “one"  indicating  low  tolerance  (most  serious)  and  a  “nine”  indicating 
high  tolerance  (least  serious).  Therefore,  the  correlations  with  this  variable  are  negative. 


Table  5.  Zero-Order  Correlations  Among  Variables 
for  Fire  Protection  (57 1X0)* 


Variables 

Variables 

1 

2 

3 

4 

S 

6 

7 

8  9 

1 .  Accident  F requency 

1.00 

2.  Occurrence/Non-occurrence 

.47 

1.00 

3.  Hazard  Potential 

.14 

.29 

1.00 

4.  Consequences  of  Inadequate 

.11 

.22 

.84 

1.00 

Performance 

5.  Task  Delay  Tolerance6 

-.14 

-.28 

-.41 

-.61 

1.00 

6.  Task  Difficulty 

-.06 

-.12 

.05 

.07 

.56 

1.00 

7.  Percent  Members 

.30 

.33 

.10 

.17 

-.64 

-.65 

1.00 

8.  Percent  Time 

.43 

.38 

.14 

.18 

-.54 

-.51 

.94 

1.00 

9.  Weighted  Average  Military 

-.13 

-.26 

-.70 

-.64 

.65 

.37 

-.47 

-.43  1.00 

Grade  Performing 

‘Correlation*  above .  1 13  ate  significant  at  the  0. 5  level,  N  =  374. 

kNote  that  task  delay  tolerance  i*  an  inverted  scale,  with  a  “one**  indicating  low  tolerance  (most  serious)  and  a  “nine"  indicating 
high  tolerance  (least  serious).  Therefore,  the  correlations  with  this  variable  are  negative. 


Table  7.  Means  and  Standard  Deviations  of  Variables  for 
Aircraft  Armament  (462X0),  Fire  Protection  (57 1X0),  and  Fuels  (63 1X0) 


The  hazard  potential  scale  was  developed  specifically  for  this  effort  as  a  predictor  of  accident  occurrences,  and 
the  hazard  potential  ratings  were  examined  in  considerable  detail.  All  the  tasks  in  each  inventory  were  ordered  from 
highest  to  lowest  on  the  mean  (across  raters)  hazard  potential  rating.  Tables  A8  through  A 10  are  extracts  of  the  ordered 
listings.  Included  in  these  tables  are  the  frequency  of  occurrence  of  accidents  and  data  for  other  job  and  task  factors. 
Of  the  accident-related  tasks  for  the  Aircraft  Armament  specialty,  91%  had  average  hazard  potential  ratings  above  the 
grand  mean  for  the  entire  specialty;  96%  of  the  accident  tasks  for  both  Fire  Protection  and  Fuels  had  mean  hazard- 
potential  ratings  above  the  mean  of  their  respective  specialties. 


Prediction  of  Accident* 


Regression  Models 

Five  regression  models  were  tested  for  predictive  efficiency.  Table  8  lists  the  variables  as  they  were  used  in  each 
model.  Squared  variables  and  direct  product  terms  were  included  to  account  for  possible  interactions  and  curvilinear 
relationships  among  the  variables.  The  regression  model  including  all  of  the  predictors  was  labeled  the  task 
characteristics  model.  All  multiple  Rs  for  this  model  within  each  of  the  specialties  were  significant  for  both  frequency 
of  occurrence  of  accidents  and  occurrence/non-occurrence  of  accidents  as  criteria.  A  restricted  model  that  was  tested 
omitted  the  criticality  variables  (consequences  and  delay),  the  difficulty  variable,  and  the  grade-performing  variable. 
The  variables  that  were  eliminated  added  no  significant  predictive  variance  except  in  predicting  the  occurrence/non- 
occurrence  criterion  for  the  Fuels  Specialty.  Table  9  lists  the  multiple  Rs  for  each  of  these  models  for  both  criteria. 


Table  8.  Variables  Included  in  Prediction  Models 


Variables 


Task 

Characteristics 


Restricted 


Models 

Hasard/ 

Exposure 


Exposure  Hasard 


1 


Specialty 


Occurrenc 
Nob- Occurrence 


Accident 

Frequency 


Aircraft  Armament  (462X0) 

Task  Characteristics 

,4579** 

.7609** 

Restricted 

.4498** 

.7555** 

Hazard/Exposure 

.4780** 

.8349** 

Exposure 

.4346** 

.7487** 

Hazard 

.2300** 

.4390** 

Fire  Protection  (571X0) 

Task  Characteristics 

.3722** 

.2757** 

Restricted 

.3452** 

.2360** 

Hazard/Exposure 

.3824** 

.3795** 

Exposure 

.3151** 

.2211** 

Hazard 

.2017** 

.0709 

Fuels  (631X0) 

Task  Characteristics 

.5641** 

.5865** 

Restricted 

.5124** 

.5797** 

Hazard/Exposure 

.5940** 

.6142** 

Exposure 

.4670** 

.5778** 

Hazard 

.2872** 

.1393* 

*£<.05. 

**£<.01. 


A  third  model,  designated  hazard/exposure,  was  considered.  This  model  contained  the  same  hazard  and  exposure 
variables  as  the  restricted  model  but  included  several  direct-product  terms  to  account  for  possible  interaction  effects. 
Significantly  higher  multiple  R’s  were  obtained  on  both  criteria  for  all  three  specialties  indicating  that  the  effects  of  hazard 
potential  were  not  the  same  for  differing  levels  of  exposure. 

In  addition  to  the  full,  restricted,  and  hazard/exposure  models,  two  other  models  were  considered.  The  exposure 
model  included  only  the  percentage  of  time  spent  and  the  percentage  of  members  performing.  Although  significantly 
different  from  zero  in  all  cases,  it  was  not  as  efficient  as  the  hazard/exposure  model  for  predicting  accident  frequency 
in  Aircraft  Armament  nor  was  it  as  efficient  for  predicting  accident  occurrences  in  any  of  the  three  specialties.  This 
suggested  that  hazard-potential  data  were  an  essential  component  to  the  prediction  system.  Similar  comparisons  between 
the  hazard/exposure  model  and  a  fifth  model  based  solely  on  hazard  data  indicated  that  the  exposure  data  also  made 
unique  contributions  to  predicting  accidents  in  all  three  specialties. 

Based  on  the  overall  analysis,  task  criticality  (delay  tolerance/consequences  of  inadequate  performance)  and  rated 
learning  difficulty  were  not  found  to  be  essential  components  of  the  prediction  system.  On  the  other  hand,  hazard  potential 
and  exposure  (percentage  of  time  spent/percentage  of  members  performing)  were  found  to  be  essential. 

Considering  all  of  the  primary  predictors,  the  percentage  of  time  spent  accounted  for  the  most  variance  in  the 
regression  models.  The  percentage  of  time  spent  correlated  .48  with  frequency  of  accidents  in  Aircraft  Armament,  .  19 
in  Fire  Protection,  and  .43  in  Fuels.  Standard  score  weights  for  the  hazard/exposure,  exposure,  and  hazard  models  using 
frequency  of  occurrence  of  accidents  as  the  criterion  variable  are  listed  in  Table  C 1  (Appendix  C). 


The  predicted  number  of  accidents  for  each  task,  based  on  regression  weights  derived  from  three  of  the  models 
(hazard/exposure,  exposure,  hazard)  and  using  frequency  of  accidents  as  the  criterion,  was  computed.  The  tasks  were 
then  ordered  from  the  task  with  the  highest  predicted  number  of  accidents  through  the  task  with  the  lowest  predicted 
number  of  accidents.  Table  10  presents  the  cumulative  percentage  of  actual  accidents  occurring  at  different  cumulative 
percentages  of  tasks.  In  all  models,  at  least  60%  of  the  accidents  were  accounted  for  in  the  first  20%  of  the  tasks.  A 
chi-square  test  was  run  on  each  of  the  sets  of  predicted  accident  tasks  to  test  the  hypothesis  that  the  distribution  of  actual 
accidents  over  predicted  accidents  was  no  better  than  chance.  The  accident  distribution  was  found  to  be  significantly 
different  from  chance  (]J<.01)  for  each  set  of  predictors.  Table  C2  gives  the  values  for  each  of  the  chi-square  tests. 


Table  10.  Classifications  of  Accident  Occurrences  on 
Predicted  Accident  Frequency 


CroM- Validation 


Two  groups  of  accident  data  were  collected  for  the  Aircraft  Armament  specialty  for  the  purpose  of  conducting  a 
cross-validation  analysis.  The  cross-validation  was  performed  to  establish  how  efficiently  the  predictor  variables  would 
perform  when  applied  to  a  second  set  of  criterion  data.  The  traditional  cross-validation  approach  was  not  followed  in 
this  study,  since  the  values  of  the  predictors  did  not  change  when  the  second  criterion  (frequency  of  occurrence)  was 
collected.  Therefore,  the  first  R2  computed  represents  the  best  least-squares  solution  given  the  original  predictors  and 
criterion.  The  second  R2  computed  represents  the  best  least-squares  solution  that  could  be  derived  given  the  original 
predictors  and  the  second  criterion.  The  cross-validated  r2  is  the  square  of  the  correlation  between  predicted  scores  using 
the  initial  model  and  the  second  criterion.  Table  1 1  shows  the  original  R2  and  R  for  each  model  for  each  sample  and 
the  cross-validation  r2  and  r.  Significant  predictive  accuracy  was  retained  for  all  models. 


Table  11.  Sample  1,  Sample  2,  and  Cross-Validation  Multiple  Rs  for 
Each  Model  with  Frequency  as  Criterion  for  Aircraft  Armament  (462X0) 


Model 

Sample  1 

Sample  2 

Crot 

•-Validation 

R* 

R 

R* 

R 

r 

Hazard/Exposure 

.70* 

.83* 

.30* 

.55* 

.22* 

.47* 

Exposure 

.56* 

.75* 

.25* 

.50* 

.21* 

.46* 

Hazard 

.19* 

.44* 

.13* 

.36* 

.14* 

.37* 

*E<.01. 


Cross- Application 

Cross-application  analyses  were  also  conducted.  The  regression  weights  for  each  model  for  each  specialty  were 
applied  to  task  factor  values  for  corresponding  models  for  the  other  specialties.  (The  predicted  scores  for  each  task  were 
conelated  with  frequency  of  accident  occurrence.)  Results  of  the  cross-application  analyses  are  reported  in  Table  12. 
Generally,  the  best  predictions  occurred  when  the  weights  from  the  Fire  Protection  specialty  were  applied  to  the  data 
from  the  other  two  specialties.  The  cross-application  held  up  best  using  the  hazard/exposure  model.  There  were  no 
significant  cross-applications  using  the  hazard  model . 


Utility  Analysis 

A  utility  model  was  developed  to  illustrate  the  application  of  the  R&D  results  to  the  Air  Force  safety  training 
community.  This  model  was  used  for  quantifying  cost  trade-offs  between  the  actual  cost  of  accidents  to  the  Air  Force 
and  the  estimated  cost  of  additional  safety  training  on  those  job  tasks  most  likely  to  be  associated  with  accidents.  This 
illustration  was  designed  to  respond  to  the  specific  needs  of  the  training  community,  which  has  the  responsibility  for 
designing  training  to  reduce  accidents.  Using  the  Aircraft  Armament  specialty,  it  was  assumed  that  special  safety  training 
would  result  in  a  50%  accident  cost  savings  to  the  Air  Force  and  also  that  the  training  cost  would  be  f  10  per  task.  These 
assumptions  were  made  for  demonstration  purposes  only  and  have  not  been  validated.  The  regression  model  that  was 
determined  to  be  most  efficient  for  predicting  the  occurrence/non-occurrence  of  an  accident,  the  hazard/exposure  model, 
was  used. 


Table  12.  Correlations  for  Cross- Application  Analyses 
for  Hur*  Regression  Models 


Specialty 

r* 

P 

Haxard/Exposure  Model 

462X0  on  57 1X0 

.00 

.04 

462X0  on  631X0 

.22** 

.47** 

571X0on  462X0 

.65** 

.81** 

571X0  on  631X0 

.17** 

.42** 

631X0on  462X0 

.07 

-.27 

631X0  on  571X0 

.03 

-.18 

Exposure  Model 

462X0on  571X0 

.02 

-.13 

462X0  on  631X0 

.29** 

.54** 

571X0  on  462X0 

.26** 

.51** 

571X0  on  631X0 

.12* 

.35* 

631X0  on  462X0 

.18** 

-.42** 

631X0on  571X0 

.04 

-.20 

Hazard  Model 

462X0on  571X0 

.00 

.05 

462X0on  631X0 

.01 

.11 

571X0  on  462X0 

.04 

.20 

571X0on  631X0 

.02 

.14 

631X0on  462X0 

.05 

.23 

631X0on  571X0 

.01 

.07 

•E<0.5. 

•*E<0.1. 


The  utility  analysis  had  three  major  components:  a  predicted  accident  score,  a  cut-off  score,  and  a  utility  score 
or  cost.  Tasks  were  first  ordered  from  high  to  low  probability  of  accident  occurrence  based  on  predicted  scores  from 
the  regression  model.  The  utility  analysis  addressed  the  question  of  how  many  tasks  should  be  included  in  training  to 
minimise  the  total  costs  associated  with  training  and  accident  occurrence.  To  answer  the  question,  an  overall  coat  value 
was  derived  incrementally  as  each  additional  task  was  considered  for  training.  The  overall  cost  at  each  iteration  was 
obtained  by  multiplying  the  number  of  tasks  above  the  cut-off  score  by  the  assumed  cost  of  training  (f  10),  adding  half 
of  the  accident  costs  of  those  tasks  above  the  cut-off  score,  and  adding  the  total  accident  costs  of  those  tasks  below  the 
cut-off  score. 

If  the  cut-off  score  were  set  at  zero,  all  tasks  would  be  trained.  The  utility  at  this  point  would  be  527  tasks  X  $10 
(cost  of  training  all  tasks)  plus  .5  X  $18,162  (half  the  cost  of  accidents),  which  would  equal  $14,351.  On  the  other  hand, 
if  the  cut-off  score  were  set  at  one,  no  tasks  would  be  trained,  and  the  utility  would  equal  $18,162  (the  total  cost  of 
theaccidenta). 

The  minimum  overall  cost  was  found  to  be  $10,428,  representing  a  $7,734  savings.  Using  this  cut-off,  the  utility 
model  identified  conrectly  19  of  the  21  actual  accident  tasks.  It  also  identified  as  accident  tasks  59  tasks  (false  positives) 
which  did  not  have  accident  occurrences  during  the  18-month  time  span.  If  this  model  were  adopted,  a  total  of  78  tasks 
would  be  singled  out  for  special  safety  training. 
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IV.  DISCUSSION 


Finding* 

The  task  factors  that  were  used  in  this  effort,  (hazard  potential,  consequence  of  inadequate  performance,  task  delay 
tolerance,  and  learning  difficulty),  each  had  high  interrater  agreement.  Low  interrater  agreement  on  any  task  factor  would 
have  precluded  that  factor  from  being  used  in  the  predictive  models  because  of  its  instability.  Two  criteria,  occurrence/ 
non-occurrence  of  accidents  and  frequency  of  occurrence  of  accidents,  were  used  during  the  course  of  this  effort.  The 
relationships  between  the  criteria  and  the  predictors  were  essentially  the  same  for  both  criteria. 

Only  two  predictors  were  significantly  correlated  with  the  frequency  of  accident  occurrence  criterion  for  all  three 
specialties:  percentage  of  time  spent,  and  percentage  of  members  performing.  Task  delay  tolerance,  consequences  of 
inadequate  performance,  weighted  average  military  grade,  and  hazard  potential  were  significantly  correlated  with  the 
criterion  in  the  Aircraft  Armament  and  Fuels  specialties  but  not  in  the  Fire  Protection  specialty.  One  factor  that  may 
have  contributed  to  low  correlations  in  the  Fire  Protection  Specialty  was  that  60%  of  the  accidents  were  attributed  to 
one  task,  “Drive  fire-fighting  vehicles.”  The  highest  accident  task  for  Fuels  was  “Drive  tank  trucks,”  which  accounted 
for  39%  of  the  accident  occurrences;  and  the  highest  accident  task  for  Aircraft  Armament  was  “Arm  or  dearm  aircraft 
armament  systems  other  than  guns,”  which  accounted  for  20%  of  the  accident  occurrences.  The  “better”  distributions 
of  accidents  on  tasks  for  Aircraft  Armament  and  Fuels  allowed  for  the  higher  correlations.  The  nonsignificant  correlation 
between  hazard  potential  and  frequency  of  occurrence  of  accidents  was  probably  due  to  the  extremely  skewed  distribution 
of  the  occurrence  of  accidents  across  tasks.  With  this  kind  of  distribution,  the  percentage  of  accident  tasks  occurring 
above  the  mean  hazard  rating  was  probably  more  representative  of  the  nature  of  the  data  than  of  the  correlation.  More 
than  90%  of  the  accident  tasks  were  above  the  mean  for  all  three  specialties. 

The  hazard/exposure  model  was  generally  more  successful  than  the  other  models;  therefore,  it  is  recommended  for 
future  use.  It  requires  the  collection  of  only  three  predictors:  hazard  potential,  percentage  of  time  spent,  and  percentage 
of  members  performing.  It  might  be  noted  that  the  exposure  model  was  almost  as  good  as  the  hazard/exposure  model 
in  cross-validation  and  cross-application.  Although  this  might  argue  for  the  exposure  model,  it  seems  more  credible  to 
recommend  the  hazard/exposure  model,  which  includes  expert  opinions  about  the  hazard  potential  of  tasks  in  addition 
to  exposure. 

There  was  moderate  shrinkage  in  multiple  Rs  from  sample  1  to  sample  2  in  the  cross-validation  analysis  due  to 
problems  in  the  criteria.  The  problems  could  have  been  attributed  to  (a)  inaccuracies  in  matching  accidents  to  task 
statements,  (b)  inaccuracies  in  the  accident  reporting  system,  or  (c)  true  changes  in  the  occurrences  of  accidents  from 
the  first  sample  to  the  second  sample.  However,  the  accident/task  matchings  were  made  by  motivated  experts  under 
controlled  conditions,  and  the  Air  Force  accident  system  is  reliable  (due  to  controls  over  time  or  money  lost  due  to  injuries 
or  damaged  equipment);  consequently,  it  is  reasonable  to  assume  that  the  shrinkage  is  due  to  the  actual  nature  of  the 
accident  data. 

The  cross-application  analyses  showed  that  the  prospects  for  developing  a  general  regression  model  for  predicting 
accidents  for  all  specialties  are  dim.  Finding  a  generalizable  model  was  not  a  main  objective  of  this  effort.  Specialized 
research  design  for  this  objective  might  result  in  different  findings. 


Applicatjons 

Several  methods  of  rank-ordering  hazardous  job  tasks  for  the  three  Air  Force  specialties  were  developed.  By  using 
the  method  of  relating  accident  data  to  occupational  survey  data,  the  subject-matter  specialists  for  each  job  specialty 
identified  tasks  that  were  involved  with  accidents.  These  accident  tasks  could  be  singled  out  for  special  safety  training. 
The  major  disadvantage  of  this  method  is  that  it  does  not  consider  those  tasks  which  have  not  yet  had  accidents  but  are 
likely  to.  However,  the  advantage  is  that  the  method  pinpoints  where  accidents  are  occurring  using  data  that  are  currently 
available  for  all  specialties. 


The  second  method  of  ordering  tasks  is  to  use  the  hazard  potential  scale  to  obtain  field  supervisory  judgments  of 
what  tasks  are  considered  the  most  hazardous.  A  listing  of  all  tasks  in  the  inventory  can  be  obtained  ordered  from  the 
highest  hazard  task  through  the  lowest  hazard  task.  The  tasks  identified  with  this  method  include  those  that  have 
previously  been  associated  with  accidents  as  well  as  those  that  have  not  been  associated  with  accidents  but  are  likely 
accident  tasks  in  the  opinion  of  expert  judges. 

The  safety  training  hazard/exposure  regression  model  is  a  third  way  to  identify  hazardous  tasks.  The  three  main 
variables  in  this  model  are  hazard  potential,  percentage  of  time  spent,  and  percentage  of  members  performing  for 
individual  tasks.  This  method  takes  into  account  the  amount  of  exposure  to  a  task  and  also  how  many  people  are 
performing  the  task.  From  the  regression  model,  a  list  of  predicted  scores  can  be  obtained  for  the  tasks  and  the  predicted 
scores  ordered  from  the  highest  through  the  lowest  predicted  scores  for  the  tasks  in  the  inventory.  This  model  is  useful 
because  it  takes  into  account  the  time  variable  and  the  number-of-people-performing  variable,  both  of  which  are 
significantly  correlated  with  the  frequency  of  accident  occurrence. 

Coupling  the  results  of  the  regression  analysis  with  the  cost-benefit  analysis  adds  an  extra  dimension  to  the  process 
of  identifying  and  ordering  tasks.  Based  on  the  hazard/exposure  model  using  occurrence/non-occurrence  of  an  accident 
as  the  criterion,  this  type  of  analysis  allows  for  the  estimation  of  how  much  money  might  be  saved  if  certain  tasks  were 
singled  out  for  safety  training. 

V.  CONCLUSIONS 

This  R&D  effort  was  concerned  with  the  identification,  measurement,  and  prediction  of  accident  tasks  for  the 
following  Air  Force  job  specialties:  Aircraft  Armament,  Fire  Protection,  and  Fuels.  A  method  was  developed  to  identify 
the  accident  tasks  using  occupational  survey  data,  accident  reports,  and  subject-matter  specialists  in  the  field.  The 
accident  tasks  were  evaluated  against  ratings  of  several  task  and  job  factors,  including  hazard  potential  which  was 
developed  specifically  for  this  effort.  Prediction  of  accident  tasks  was  tested  using  several  regression  models.  Four 
strategies  for  prioritizing  hazardous  tasks  within  a  specialty  were  proposed. 

The  following  procedures  appear  to  be  feasible: 

1 .  Matching  descriptions  of  accident  occurrences  with  job  tasks. 

2.  Evaluating  hazard  potential  by  eliciting  supervisor  judgments. 

3.  Estimating  accident  occurrences  by  considering  hazard  potential  and  exposure. 

4.  Applying  cost-minimization  strategies  to  the  problem  of  determing  which  tasks  to  train. 

The  hazard-potential  scale  and  the  techniques  developed  in  this  effort  are  specialized  tools  that  would  be  of  value 
in  those  job  specialties  where  accidents  are  most  frequent  and  costly  in  terms  of  loss  of  life,  time,  and  material.  Of  the 
four  techniques  described,  the  accident  task  matching  and  the  ordering  of  tasks  on  the  hazard  potential  scale  are  the 
simplest  to  accomplish.  The  regression  models  and  cost-benefit  analysis  are  more  sophisticated  and  time-consuming, 
but  also  render  more  information  about  the  nature  of  the  tasks  and  the  costs  for  safety  training.  Any  of  these  techniques 
would  be  beneficial  to  the  training  community  if  tailored  to  the  specific  needs  of  the  job  specialty . 
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Accident 

Frequency 


Tut 


Description 


Accident 

Frequency 


Table  A3.  Accident  Tulu  for  Facia  (63 1X0) 


Taak 

Namber 

PwtrlpItoB 

Accident 

Frequency 

G189 

Connect  or  disconnect  off-loading  hoses  from  railway 
tank  cars,  trucks,  or  trailers 

i 

G190 

Dispose  of  unsuitable  products 

i 

G194 

Fill  mobile  refueling  units  from  bulk  storage 

4 

G197 

Inspect  loaded  bulk  fuel  compartments  or  containers  of 
delivering  carriers 

1 

G200 

Inspect  tanks  selected  to  receive  fuel 

12 

G202 

Inspect  unloaded  bulk  fuel  compartments  or  containers  of 
delivering  carriers 

1 

G203 

Monitor  hoses,  valves,  or  pumps  during  receiving  operations 

6 

G205 

Position  off-loading  valves  at  proper  locations 

6 

H219 

Drive  tank  trucks 

40 

H220 

Drive  tractors 

1 

H221 

Drive  tractor-trailer  combinations 

1 

H225 

Fuel  aircraft  with  modified  Panero  hydrant  systems 

1 

H226 

Fuel  ac raft  with  Panero  hydrant  systems 

1 

H227 

Fuel  aircraft  with  Phillips  hydrant  systems 

1 

H228 

Fuel  aircraft  with  Pritchard  hydrant  systems 

8 

H233 

Fuel  or  defule  aircraft  with  R-2  Condec  tank  trucks 

1 

H234 

Fuel  or  defuel  with  R-2  Heil  tank  trucks 

1 

H235 

Fuel  or  defuel  aircraft  with  R-5  tank  trucks 

2 

H237 

Fuel  or  defuel  aircraft  with  R-9  tank  trucks 

4 

1263 

Perform  operator  maintenance  on  bulk  storage  systems 

2 

1270 

Perform  operator  maintenance  on  Pritchard  hydrant  systems 

2 

1271 

Perform  operator  maintenance  on  tank  trucks 

5 

K307 

Inspect  to  insure  proper  vehicle  operator  maintenance 
has  been  performed 

1 

X  o 


Description 


Aceidett 

Frequency 


Duty 

E  Working  with  forms,  records,  reports,  directives, 

and  technical  data  1 

F  Loading  and  unloading  munitions  and  weapons  on  aircraft  32 

G  Performing  flight-line  inspections  of  aircraft  suspension, 

release,  launch,  and  monitor  and  control  systems  1 

H  Performing  operational  checks  of  aircraft  suspension, 

release,  launch,  and  monitor  and  control  systems  8 

O  Maintaining  equipment  and  aerospace  ground  equipment  (AGE)  1 

Q  Shipping  and  transporting  munitions  1 1 


Table  AS.  Accident  Duties  for  Fire  Protection  (57 1X0) 


Accident 

Duty  Description  Frequency 


D  Training  1 1 

F  Performing  general  fire  protection  duties  56 

G  Inspecting  fire  alarm  systems,  automatic  installed 

sprinkler  systems,  and  fire  prevention  devices  1 

K  Fighting  structural  fires  (frame  and  masonry)  3 

L  Fighting  aerospace  vehicle  flies  3 

M  Performing  rescue  operation  2 

N  Servicing  and  testing  equipment  and  installed  systems  1 

O  Maintaining  equipment  7 

P  Maintaining  and  repairing  fire  extinguishers  2 

S  Performing  maintenance  on  runway  barriers  2 


Table  A6.  Accident  Duties  for  Fuel  (63 1X0) 


Accident 

Duty  Description  Frequency 


Receiving  bulk  fuels  32 

Issuing  bulk  fuels  61 

I  Performing  operator  maintenance  9 

K  Perform  quality  control  functions  1 


29 


u 


Table  A  7.  Task  and  Job  Factor*  Scale* 


1.  Hazard  Potential 


Rating  Scale 

1  Extremely  low  hazard  potential 

2  Very  low 

3  Low 

4  Below  average 

5  Average 

6  Above  average 

7  High 

8  Very  high 

9  Extremely  high  hazard  potential 

2.  Probable  Consequences  of  Inadequate  Performance 

Rating  Scale 

1  Minimal  (inadequate  performance  has  minimal  consequences) 

2  Slight 

3  Not  very  serious 

4  Fairly  serious 

5  Serious 

6  Very  serious 

7  Extremely  serious 

8  Almost  disastrous 

9  Disastrous  (indequate  performance  has  disastrous  consequences) 

3.  Task  Delay  Tolerance 

Rating  Scale 

1  Extremely  low 

2  Very  low 

3  Low 

4  Below  average 

5  Average 

6  Above  average 

7  High 

8  Very  high 

9  Extremely  high  (can  wait  for  a  long  time) 

4.  Task  Difficulty 

Rating  Scale 

1  Extremely  low 

2  Very  low 

3  Low 

4  Below  average 

5  About  average 

6  Above  average 

7  High 

8  Very  high 

9  Extremely  high 
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5.  Time  Spent 


Rating  Scale 

1  Very  small  amount 

2  Much  below  average 

3  Below  average 

4  Slightly  below  average 

5  About  average 

6  Slightly  above  average 

7  Above  average 

8  Much  above  average 

9  Very  large  amou  nt* 
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APPENDIX  B:  SURVEY  BOOKLET  INSTRUCTIONS  AND  SAMPLE  ANSWER  SHEETS 


Hazard  Potential 
INSTRUCTIONS 

1.  Explanation:  In  the  Air  Force  some  tasks  are  more  hazardous  to  perform  than  others.  For  example,  the  possibility 
of  a  serious  accident  occurring  while  loading  munitions  is  much  more  likely  than  while  estimating  budget  requirements. 
Some  tasks  have  a  higher  “hazard  potential”  than  others  due  to  a  variety  of  factors  such  as  the  consequences  of  inadequate 
performance  of  the  task,  possibility  of  mechanical  failure,  environmental  conditions,  etc.  This  booklet  contains  a  listing 
of  supervisory  and  worker  level  tasks  performed  in  your  career  ladder.  You  are  asked  to  evaluate  each  task  to  indicate 
the  “hazard  potential”  of  the  task. 

2.  Please  complete  this  booklet  in  two  steps: 

Step  L  Read  through  the  list  of  task  statements  and  check  any  task  which  you  consider  to  have  a  hazard  potential. 
Make  your  checks  in  the  CHECK  (^ )  column,  to  the  right  of  the  listed  task  statements. 

Step  2.  After  the  completion  of  Step  1,  rate  only  the  tasks  you  checked  to  indicate  how  potentially  hazardous  you 
feel  each  task  may  be.  Using  the  following  9-point  rating  scale,  make  your  ratings  by  writing  the  numbers 
1  through  9  in  the  HAZARD  POTENTIAL  column.  For  example,  if  you  think  a  task  has  “extremely  high 
hazard”  potential,  then  write  the  number  “9”  next  to  the  task. 

Rating 

Scale  Hazard  Potential 

1  Extremely  low  hazard  potential 

2  Very  low 

3  Low 

4  Below  average 

5  Average 

6  Above  average 

7  High 

8  Very  high 

9  Extremely  high  hazard  potential 

3.  Your  efforts  in  completing  this  booklet  will  be  sincerely  appreciated.  When  you  have  finished  your  ratings,  please 
return  this  booklet  to  your  CBPO/DPMPC. 
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Aircraft  Armament 

AFSC 

462X0 


CHECK  (v^)  AND  RATE  ANY  TASK  WHICH 
YOU  CONSIDER  POTENTIALLY  HAZARDOUS. 


JOB  INVENTORY 

(DUTY  -  TASK  LIST) 


F. 

LOADING  AND  UNLOADING  MUNITIONS  AND  WEAPONS  ON  AIRCRAFT 

1. 

Arm  or  dearm  aircraft  armament  systems  other  than  guns 

2. 

Complete  munitions  post  load  inspections  or  procedures 

3. 

Inspect,  connect,  or  disconnect  mechanical  lanyards  or 
disconnects  while  loadinq  or  unloadinq 

4. 

Inspect,  connect,  or  disconnect  munitions  electrical 
cables  while  loadinq  or  unloadinq 

5. 

Inspect  non-nuclear  munitions  prior  to  loading  on 
aircraft  or  preload  stands 

6. 

Inspect  nuclear  weapons  prior  to  loading  on  aircraft 
or  preload  stands 

7. 

Inspect  shackles  or  bomb  racks  for  operation  or  damage 
durinq  loadinq 

8. 

Inspect  suspension  gear  such  as  pylons,  rails,  or  racks 
prior  to  loading 

$. 

Load  or  unload  non-nuclear  munitions  on  aircraft  or 
preload  stands  or  racks 

10. 

Load  or  unload  nuclear  weapons  on  aircraft  or  preload 
stands  or  racks 

:  1 

********** 

HI 

Load  or  unload  preloaded  non-nuclear  munitions  on  aircraft 

Ififl 

Load  or  unload  preloaded  nuclear  weapons  on  aircraft 

rrrr 

i — r-: - 

Perform  functional  checks  or  tests  on  aircraft  armament 
circuits  while  loadinq 

TTi  Perform  post  maintenance  safety  checks  of  munitions 


TT!  Perform  pre-maintenance  safety  checks  of  munitions 


16. 

Prepare  non-nuclear  munitions  for  loading  on  aircraft  or 
preload  stands 

Prepare  nuclear  weapons  for  loading  on  aircraft  or 
preload  stands 

181 Preposition  munitions  prior  to  loading  on  aircraft  or 
preload  stands 


Consequences  of  Inadequate  Performance 
INSTRUCTIONS 


Explanation 

This  booklet  contains  a  listing  of  tasks  performed  in  your  career  ladder.  You  are  asked  to  rate  each  task  to  indicate 
the  Probable  Consequences  of  Inadequate  Performance  of  the  task.  In  the  Air  Force,  the  consequences  of  inadequate 
performance  of  some  tasks  are  much  more  serious  than  for  other  tasks.  For  example,  if  inadequate  performance  of  a 
task  will  almost  certainly  cause  an  aircraft  to  crash,  or  a  warehouse  to  bum  down,  or  an  airman  to  die,  this  would  be 
more  serious  than  inadequate  performance  of  a  task  which  merely  causes  incovenience  and  irritation.  As  another 
example,  the  probable  consequences  of  inadequate  performance  in  responding  to  a  fire  alarm  would  be  much  more  serious 
than  the  probable  consequences  of  inadequate  performance  in  folding  hospital  linen. 

Definition 


Consequences  of  Inadequate  Performance  is  a  measure  of  the  seriousness  of  the  probable  consequences  of 
inadequate  performance  of  a  task.  It  is  measured  in  terms  of  possible  injury  or  death,  wasted  supplies,  damaged 
equipment,  wasted  man-hours  of  work,  etc. 

Your  Task 

Using  the  rating  scale  below,  assign  a  numerical  rating  to  each  task  in  this  booklet  which  you  feel  describes  the 
probable  consequences  of  inadequate  performance  of  the  task.  Make  your  ratings  by  simply  writing  a  number  1  through 
9  in  the  column  to  the  right  of  each  task.  Please  attempt  to  rate  all  tasks. 

Rating  Scale 

If  the  task  is  not  done  correctly,  the  probable  consequences  of  inadequate  performance  would  be: 

1 .  Minimal  (inadequate  performance  has  minimal  consequences) 

2.  Slight 

3.  Not  very  serious 

4.  Fairly  serious 

5.  Serious 

6.  Very  serious 

7.  Extremely  serious 

8.  Almost  disastrous 

9.  Disastrous  (inadequate  performance  has  disastrous  consequences) 


Your  efforts  in  completing  this  booklet  will  be  sincerely  appreciated.  When  you  have  finished  your  ratings,  please  return 
this  booklet  to  your  CBPO/DPMPC. 


JOB  INVENTORY 

(DUTY  -  TASK  LIST) 


If  the  t:.';!;  is  Not  done  correctly, 
the  Probable  Consequences  of  Inade¬ 
quate  Performance  would  be: 


afsc 

631X0 


RECEIVING  BULK  FUELS 


•  Clean  or  store  storage  facility  equipment  such  as 
inq  equipment,  wrenches  or  other  tools 


•  Clean  receiving  strainers  after  operations 


•  Connect  or  disconnect  grounding  or  bonding  on  barges 


•  Connect  or  disconnect  grounding  or  bonding  on  railway 
tank  cars,  trucks  or  trailers 


b.  Connect  or  disconnect  off-loading  hoses  from  barges 


.  Connect  or  disconnect  off-loading  hoses  from  railway 
tank  cars,  trucks  or  trailers 


'•  Dispose  of  unsuitable  products 


8.  Drain  accumulation  of  water  from  delivery  vehicles 


.  Drain  water  from  storage  tanks 


•  Examine  fuel  and  take  hydrometer  readings  during 
multiple  product  shipments  by  pipe  lines  -■ _ 


Fill  mobile  refueling  units  from  bulk  storage 


Gauge  shipments  for  water  using  pole  or  tape  and  paste 


Gauge  tanks  for  fuel  quality  and  temperatures 


Inspect  loaded  bulk  fuel  compartments  or  containers  of 
ng  carriers _  _ _ 


nspect  meters  for  correct  operation 


PACE  12  OF  26  f,A' 


PROBABLE 
CONSEQUENCES 
OF  INADEQUATE 
PERFORMANCE 

1.  Minimal 

2.  Slight 

3.  Not  Very  Seriou*. 

4.  Fairly  Serious 

5.  Serious 

6.  Very  Serious 

7.  Extremely  Sere. us 

8.  Almost  Disastrous 

9.  Disastrous 


nspect  shipments  tor  type  ruei,  sediment,  or  water 


nspect  tanks  selected  to  receive  fue 


nspect  unloaded  bulk  fuel  compartments  or  containers  of 
delivering  carriers 


Monitor  hoses,  valves,  or  pumps  during  receiving 
operations 


Perform  dock  watch  during  ocean  tanker  off-loadings 


( Continue*  npvt  nano) 
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Task  Delay  Tolerance 
INSTRUCTIONS 


Explanation 

This  booklet  contains  a  listing  of  tasks  performed  in  your  career  Ladder.  You  are  asked  to  rate  each  task  to  indicate 
the  Task  Delay  Tolerance.  Task  Delay  Tolerance  is  a  measure  of  how  much  delay  can  be  tolerated  between  the  time 
the  airman  becomes  aware  that  the  task  must  be  performed  and  the  time  actual  performance  must  begin. 

For  some  tasks  encountered  by  airmen,  no  delay  can  be  tolerated  between  the  time  the  need  for  the  task  becomes 
evident  and  the  time  actual  performance  must  begin.  The  airman  who  encounters  the  task  must  be  able  to  do  it  then, 
without  any  delay  to  read  up  on  the  task  or  find  someone  to  advise  him.  For  other  tasks,  some  delay  is  acceptable  while 
the  airman  gets  advice,  checks  Technical  Orders,  etc. 

Examples 

Some  examples  of  tasks  having  low  Delay  Tolerance  and  which  must  be  performed  without  delay  are: 

Use  artificial  respiration  to  restore  breathing. 

Pull  ripcord  of  emergency  parachute  if  main  parachute  fails. 

Extinguish  fire  in  aircraft  engine  during  startup  on  flight  line. 

Some  examples  of  tasks  having  higher  task  delay  tolerance,  and  for  which  some  delay  to  get  advice  or  read  an  instruction 
manual  would  be  acceptable,  are: 

Review  books  for  unit  library. 

Clean  and  lubricate  typewriter. 

Refill  fire  extinguisher  alter  use. 


Your  Task 


Using  the  rating  scale  below,  assign  a  numerical  rating  to  each  task  in  this  booklet  which  you  feel  describes  the 
appropriate  task  delay  tolerance.  Make  your  ratings  by  simply  writing  a  number  1  through  9  in  the  column  to  the  right 
of  each  task.  Please  attempt  to  rate  all  tasks. 

Rating  Scale 

1.  Extremely  low  delay  (must  do  immediately) 

2.  Very  low 

3.  Low 

4.  Below  average 

5.  Average 

6.  Above  average 

7.  High 

8.  Very  high 

9.  Extremely  high  delay  (can  wait  for  a  long  time) 

Your  efforts  in  completing  this  booklet  will  be  sincerely  appreciated.  When  you  have  finished  your  ratings,  please  return 
this  booklet  to  your  CBPO/DPMPC. 
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JOB  inventory 

(Durr  -  TASK  LIST ) 


Rate  each  task  to  indicate  the 
amount  of  time  a  person  can  delay 
before  starting  to  perform  the  task. 


PERFORMING  GENERAL  FIRE  PROTECTION  DUTIES 


1 .  Dry  hoses 


2.  Drive  firefighting  vehicles 


sh  amount  of  wor 


.  Establish  equipment  positions 


.stablish  positions  to  fight  fires 


i  6.  Hook  up  or  unhook  hoses  at  fire  hydrants 


oses  at  water  tankers 


oses  or  make  hose  load  finishes 


perate  extinguishers 


perate  hand  or  booster  lines 


perate  powered  wood  or  masonry  saws 


perate  pumper  drafts  or  pressure  controls 


erronp  fire  vehicle  relay  operations 


erform  master  stream  operations 


errorm  reverse  nose  lays 


erform  Siamese  or  wye  connection  hose  lays 


ose  lays 


ace  vehicle  hose  crossovers 


osltlon  or  operate  smoke  ejectors 


TASK  DELAY 
TOLERANCE 

1.  Extremafy  Low 
Delay 

2.  Very  Low 

3.  Low 

4.  Below  Average 
6.  Average. 

6.  Above  Average 

7.  High 

8.  Very  High 

9.  Extremely  High 
Delay 


E 


